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It will be expedient to cause such a local distortion by a local displacement of a respec- 
tive node of the centered reference graph. 

In accordance with an advantageous embodiment, the displacement and/or the scaling 
and/or the rotation can be determined on the basis of a comparison between the image 
graph and the corresponding reference graph and/or the corresponding reference bunch 
graph. This will lead to a substantial increase in the recognition speed. 

Further preferred embodiments result from the subclaims and from the description of pre- 
ferred embodiments of the method according to the present invention, which will be de- 
scribed hereinbelow making reference to the drawing, in which: 

Fig. 1 shows an image of a hand position with a reference graph for explaining one 
embodiment of the present invention; 

Fig. 2 shows the reference graph according to Fig. 1; 

Fig. 3 shows a schematic representation for determining a graph from a reference 
image according to one embodiment of the present invention; 

Fig. 4 shows a schematic embodiment for explaining a further embodiment of the 
present invention; 

Fig. 5 shows images of hand positions from which a reference data base has been 
ascertained; 

Fig. 6 shows examples of images of a hand position with different backgrounds which 
were compared with the images of Fig. 4 by means of one embodiment of the 
present invention. 

In the following, the various embodiments of the present invention will be described on the 
basis of a method for recognizing the position of a hand, referred to as hand position here- 
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inbelow. This description must, however, not be regarded as a restriction, but only as an 
example of a method for recognizing structures and objects, respectively, in images. 

Fig. 1 shows, by way of example, an image 20 of a hand at a certain position. 

For carrying out the method according to the present invention, the image 20 must exist in 
digitized form. The digitized form can either directly result from the recording technique in 
question, e.g. when a CCD camera is used, or it must be obtained by converting an analog 
picture, e.g. a conventional photo. 

A digitized image exists typically in the form of a pixel field having a predetermined size. 

, Each pixel has associated therewith a horizontal and a vertical position x . Hence, pixel x 

~ stands hereinbelow for the pixel which has had associated therewith the position x . In ad- 
dition, each pixel has assigned thereto a grey value and/or a colour information value, such 
as an HSI value. 

' Local image information, so-called features, which are, in turn, combined to form so-called 
: jets, is now extracted from the digitized image 20 and/or from the image data corresponding 
to said digitized image within the framework of the method according to the present inven- 
tion. These extracted features are arranged in the form of a graph. 

The predetermined pixels are obtained in that a net-like structure 21 , which, for the sake of 
simplicity, will be referred to as grid in the following, is first projected into the image 20. 

As can be seen from Fig. 2, in which this grid 21 is shown in detail, the grid used in the first 
embodiment comprises 15 nodes 22a, 22b, 22c, ... and 19 links, i.e. connections between 
two respective nodes. In Fig. 2 the links between the nodes 22a and 22b, and 22b and 22c 
are designated by reference numerals 23ab and 23bc, respectively. 

Finally, the predetermined pixels are obtained by determining the pixels corresponding to 
the projection of the nodes. 
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In the first embodiment an object-adapted grid is used, i.e. the nodes are associated with 
characteristic points in the image. For recognizing the position of a hand, the nodes are 
therefore assigned to the two fingers and the back of the hand, as can be seen in Fig. 1 . 

The present invention is, however, not limited to such object-adapted grids, but it is also 
possible to use grids in the actual sense of the word, i.e. regular grids. The decision which 
form of grid will be expedient, depends on the respective case of use. In comparison with 
regular grids, object-adapted grids will normally lead to a more significant recognition, but 
they are more difficult to handle. 

Fig. 3 shows a schematic representation on the basis of which it is explained how a repre- 
sentation in the form of a graph is obtained from image 20; as will be explained hereinbe- 
low, this representation in the form of a graph can be compared with other graphs, in par- 
ticular with reference graphs. 

When specific pixels have been determined by the grid, as can be seen in Fig. 3(a), the 
features in these pixels are extracted as described hereinbelow. 

In the first embodiment two different classes 28 and 29 of features are used for comparing 
the image with a reference image. 

The first class of features 28a, 28i is defined as the result of a convolution of the image 
at a predetermined pixel with a given filter function. 

According to the first embodiment, so-called complex Gabor filters are used as filter func- 
tions for this purpose. These filters can be represented by the following formula: 




(1) 



The Gabor filters represented by equation (1) have the form of a plane wave described by a 
wave vector kj and limited by a Gaussian function having a width o / k, wherein c = 2n. By 
selecting the wave vector k s the magnitude and the orientation of the filter function can be 
determined. 



In addition, the filter functions satisfy the condition: 

X^i = 0. (2) 



In Fig. 3 (c) the real parts of such two different filter functions are shown, cf. 24a and 24b. 
The value 0 is represented by a medium grey; positive values are brighter and negative 
values are darker. The filter function 24a shown in Fig. 3(c) has a low frequency and a small 
wave vector k i with an orientation of approximately 60 degrees relative to the horizontal. 
The filter function 24b has a higher frequency and a larger wave vector kjWith an orienta- 
tion of approx. 90 degrees relative to the horizontal. 

It follows that for a predetermined wave vector k,- , i.e. by selecting the magnitude and the 
orientation of the filter function, the feature J^x) can be calculated at a predetermined pixel 
x by: 



J,(x) = 2'(x')¥j(x-x'). (3) 
fx) stands for the intensity in this equation. 



In dependence upon the wave vector k } , various features J } (x) can now be calculated for 

each pixel x , said various features being combined in a sub-jet for the pixel x in the first 
embodiment. 



In the images in Fig. 3(d), which are designated by 26a and 26b, respectively, the results of 
the convolutions of image 20 with the filter functions 24a and 24b are shown for all pixels x . 



When the wave vector k, is represented by: 



- _fk v cosdO 
Kj ~U v sin<j)J 



v+2 



wherein v is the magnitude index and n is the orientation index of the filter function, the 
features for the indices n e {0,..., 7} and v e {0,..., 4} are combined in a sub-jet 28 of jet 27 
in accordance with the first embodiment. 

It follows that the sub-jet 28 for the pixel x comprises a total of n=40 features. 

In Fig. 3 part of these features is schematically shown in the sub-jet 28. Features 28a, 28b 
and 28c were obtained by means of filter functions having a constant magnitude and, as 
can be seen from the hatching, different orientations. The same applies to features 28d, 
28e and 28f as well as 28g, 28h and 28i. In comparison with features 28a, 28b and 28c, 
features 28d, 28e and 28f as well as 28g, 28h and 28i result from a convolution with a 
smaller filter function. 

In addition to the above-described Gabor filter functions, arbitrary other filter functions can 
be used as well. According to a further embodiment of the present invention, so-called 
Mallat filters are used as a further example of a class of filter functions. 

The convolution of the image with these Mallat filters can be expressed by the following 
formula: 




(5) 
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wherein * stands for the convolution operation, h and v stand for horizontal and vertical, and 
Si (Sj = s 0 2', i e N) represents the width of a Gaussian function whose derivatives are used 
as filter functions. 

The second class of features 29a, 29i is defined as the result of a convolution, at a pre- 
determined pixel, of data with a given filter function, said data resulting from a conventional 
colour space segmentation of the image data. In the present case, the colour space seg- 
mentation was carried out with respect to the skin colour. It goes without saying that, de- 
pending on the respective case of use, the colour space segmentation can also be carried 
out with respect to other colours. In Fig. 3(b) the image data 22 are shown after the colour 
space segmentation. 

In the present embodiment, the convolution of the colour space-segmented data was car- 
ried out analogously to the convolution of the image data, i.e. with the same Gabor filters of 
_ the same magnitude and orientation. Hence, a detailed description of this convolution op- 
eration can be dispensed with; in this connection, reference is made to the respective para- 
graphs dealing with the convolution of the image data with the Gabor filters. 

It should, however, additionally be pointed out in this connection that in Fig. 3(e) the colour 
space-segmented image data folded with the filter functions are shown. The images 25a 
and 25b in Fig. 3(e) represent the real parts of a convolution of the colour-segmented image 
data with the filters whose real parts are designated by 24a and 24b in Fig. 3(c). 

Analogously to the features resulting from the convolution of the image data with the Gabor 
filters, also the features obtained by folding the colour space-segmented image data with 
the Gabor filters are combined in a sub-jet 29. Since the magnitude index and the orienta- 
tion index of the filter functions have been chosen in this embodiment as described above, 
the sub-jet 29 also comprises n=40 features for the pixel x , the features 29a, 29i being 
shown representatively. 

It goes without saying that, instead of the Gabor filters, other filter functions, such as the 
Mallat filters which have already been mentioned, can be used in this case as well. 
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The sub-jets 28 and 29 define the jet 27 in the first embodiment. The jet 27 finally com- 
prises 80 features in this embodiment. 

When the extraction of the features is carried out at all points of the grid, the desired graph 
will finally be obtained, said graph reflecting the structure of the grid 21 and comprising the 
jets at the points corresponding to the grid points. 

According to a further embodiment, colour information obtained from the image data, such 
as the hue, colour saturation and intensity (HSI), is used, instead of the convolutions of the 
filter functions with the colour-segmented data, as second class for the pixel. According to 
this embodiment, a single jet is therefore composed of 40 features resulting from the 
above-described convolution of the image data with the Gabor filter functions and of the HSI 
triple; hence, it comprises 43 features. 

It will be expedient to used a weighted Euclidian distance in the HSI colour space as a 
comparison function between two HSI triples. 

In addition, a jet is composed of three classes in the case of a further embodiment. The first 
class comprises the features resulting from the convolution of the image data with the Ga- 
bor filters (Gabor features); the second class comprises the features resulting from the 
convolution of the colour space-segmented image data with the Gabor filters (colour-gabor 
features); and the third class comprises the HSI triple obtained from the image data (colour 
information). 

According to a further embodiment, a texture description gained by statistical methods can 
be used alternatively to or in addition to the above-described classes. Such texture descrip- 
tions are e.g. the medium grey value, the variance of the grey value distribution, the covari- 
ance matrix of the grey value distribution, the entropy, the orientation of the grey value 
structure, medium scales of the structure in various directions, the variation range of the 
local orientation, the variation range of the spatial scales, the sequence and the arrange- 
ment of various elements of the structure. 

In addition, and again alternatively to or in addition to the above-described classes, motion 
vectors (displacement vectors) are defined as a class according to a further embodiment. 
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Such motion vectors can be calculated from two successive images by means of differential 
geometric methods (differential methods), correlation methods and filter methods. Further- 
more, it is also possible to calculate motion vectors from two Gabor jets. 

In addition to the embodiments described in detail, a large number of combination possibili- 
ties of the above-described classes exist in dependence upon the field of use, i.e. the 
structure, the quality and the complexity of the content of the image data to be compared. It 
is especially also possible to use the features of only one of the above-described five 
classes for the comparison. In particular, it is also possible that features resulting from con- 
volutions of the image data with a first filter class define the first class, and that features 
resulting from convolutions of the image data with a second filter class define the second 
class. 

In the following it will be described how an image is compared with a reference image. The 
first word "comparison" in compound words refers to the respective image recorded in 
which the structure or the object is to be recognized. 

To begin with, a reference image in the form of a graph, i.e. in the form of a reference 
graph, must be provided. This can be done e.g. by fetching the reference graph from a 
central data base or a decentralized data base, e.g. from chip cards. 

When the data base is being created, this reference graph G is determined according to 
one of the above-described methods. In the present case, a grid of the type shown e.g. in 
Fig. 2 is therefore projected into the reference image. At the nodes of the grid, the jets are 
determined, as has already been explained hereinbefore as well. The jets of the reference 
graphs should comprise at least the classes of features which are to be determined for the 
comparison graph as well. 

In the next step, the grid of the reference image (reference grid) is projected into the com- 
parison image and the jets corresponding to this grid are calculated for the comparison im- 
age. In so doing, filter functions, i.e. the same class of filter functions, the same magnitudes 
and/or the same orientations, with which the reference graph has been created should be 
used at least partially. The thus calculated jets together with the structure of the projected 
grid will finally define the comparison graph G'. 
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In dependence upon the differences between the reference images and the comparison 
images to be expected, various mappings can be used for projecting the reference grid into 
the comparison image. 

The simplest projection, viz. centering the reference grid in the comparison image, will e.g. 
be suitable for cases where the reference image and the comparison image have the same 
size and the same position with respect to the image centre and have been recorded at the 
same angle. 

In addition to this simple projection, the following projections can be carried out selectively. 
Displacement of the reference grid in its entirety: 

this mapping will be suitable for cases where the reference image and the comparison im- 
age occupy different positions with respect to the image centre. 

Scaling of the reference grid: 

this mapping can be provided in cases where the reference image and the comparison im- 
age are different in size. 

Rotation of the reference grid: 

a rotation can be used in cases where the reference image and the comparison image are 
rotated relative to one another. 

Local distortion of the reference grid: 

in the case of this mapping individual points of the grid are displaced relative to their posi- 
tion in the reference grid. This mapping is particularly suitable for cases where it is to be 
expected that the comparison image shows local distortions in comparison with the refer- 
ence image. 

It goes without saying that arbitrary combinations of the above-described projections are 
possible as well. 
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The evaluation of the similarity of the two graphs is carried out by means of a graph com- 
parison function of the following general form: 

S = S Jet +^S Metrik . (6) 



S Jet stands here for the jet comparison function, i.e. a suitable function which evaluates the 
similarity of the jets at corresponding points of the two graphs, and S Me trik stands for a suit- 
able function which compares the similarity of the metrics of the two grids. S Metr ik depends 
strongly on the projection used. 



X (k > 0) designates the weighting of the two comparison functions relative to one another. 
X can also be made equal to zero; this means that the similarity of the metrics of the graphs 
is not taken into account. This value will be particularly expedient in cases where only cen- 
tering or displacement is chosen as projection or, in other words, where the topologies of 
the reference graph and the comparison graph are identical. 

For calculating the jet comparison function S Jet , it will first be necessary to calculate the 
comparison functions of the sub-jets for the respective classes k. In the case of the first 
embodiment, whose features result from a convolution of the image data and of the colour 
space-segmented data with Gabor filters, k would be equal to 2. 

For evaluating the similarity of two corresponding sub-jets j k and j k ' of the jets j and j" of the 
reference graph G and of the comparison graph G', respectively, a sub-jet comparison 
function is used, i.e. a function which depends on the amplitudes aj and a/ of the two sub- 
jets and which has the following form: 



v)- ^ 



The present invention is, however, not limited to this comparison function; it is also possible 
to use a phase-sensitive comparison function having e.g. the following form: 



2 a j ajcos(<t> j — <j)| — d-kj) 



wherein kj is the wave vector of the respective Gabor filters and d is an estimated 
displacement vector which compensates fast phase shifts, d is determined in that 
is maximized in its Taylor development within a small square, which is centered in 
d = 0. The term dkj with the estimated displacement vector d finally compensates 
fast phase shifts on the basis of small variations of the positions x and x' of the two 
jets compared with one another. 

a^x) and <j )j (x) result in this case from J^x) = a j (x)exp(ic() j (x)) . 

A single jet comparison function for the respective individual jets can be formed 
making use of the sub-jet comparison functions for the sub-jets corresponding to one 
another, i.e. for the features of a class: 

S(J,J') = n({S k (j k ,j k ')}). (9) 

Depending on the respective case of use, different functions Q can be used, for example 

^({S k (j k jV)}) = Z G) k S k (j k ,j k t ),or (10) 

k 

"({S k (j k J k , )}) = n(S k (j k ,j k ')r,or (11) 

"({^(jk.jVJ^maxfcD^ajV)} (12) 
"({S k (j k , j k ' )}) = m in{© k S k (j k) j k 1 )} (1 3 ) 
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S k(jkJk' ) are he re the sub-jet comparison functions which can be calculated accord- 
ing to equations (7) or (8); © k are weighting coefficients which describe the contribu- 
tion of a single sub-jet to the single jet comparison function S(j, j' ) . 

The jet comparison function S Je t for all the corresponding jets of a reference graph G 
and of a comparison graph G' is finally formed from the single jet comparison func- 
tions for the individual jets. For this purpose, different functions can be used, again in 
dependence upon the respective case of use. The comparison function for n jets can, 
for example, be formed according to: 



S n (J n . J n') are here the single jet comparison functions which can be calculated ac- 
cording to equations (10) to (13); o n are weighting coefficients which describe the 
contribution of a single jet to the jet comparison function S Jet . 

The magnitudes of the differential vectors of two corresponding links, i.e. of the con- 
nections between two corresponding nodes, can, for example, be added so as to 
obtain the function for comparing the metrics of the two graphs; hence, the following 
metric comparison function is obtained for graphs with E links, which are referred to 
as Ax e and Ax e ' , respectively: 



S jBl (Gy©) = 2a>nS„(J„,J 1 , , ),or 
S Je ,(QG') = n(S n (J n ,J n ')r. 



(14) 



(15) 



SMetriJCG') = |Z(^e-AX;) 2 . 



(16) 



Which of the comparison functions is used in detail and, in particular, what factor is chosen 
for X depends essentially on the structure of the reference graphs and of the comparison 
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graphs, i.e., in the final analysis, on the structure of the comparison images and of the ref- 
erence images. 

The selection of the suitable comparison function for a given structure of the comparison 
images and of the reference images can be determined by means of comparison tests with 
the comparison images and the reference images and does therefore not exceed the scope 
of the normal ability of a person skilled in the art. 

The comparison graph can now be optimally adapted to the reference graph with the aid of 
the graph comparison function (6). For this purpose, the projection of the reference grid into 
the comparison image is varied until the graph comparison function assumes an optimum 
value (in the case of the above-described comparison functions this optimum value is a 
minimum). 

It is, of course, also possible to compare several reference images with the comparison im- 
age. 

These reference images may exist in the form of a data base. In this case it will, however, 
be necessary to calculate the reference graphs again for each comparison. 

It will therefore be more expedient to provide the data base in the form of a reference graph 
data base from the very beginning, the reference grids with their respective jets being 
stored in said reference graph data base and being simply fetched therefrom. Such a refer- 
ence graph data base is, however, not as flexible as a reference image data base, since it 
has to be recompiled for each change in the calculation of the jets. 

For comparing the comparison image with an arbitrary number of reference images, the 
optimum adaptation to each reference image and the graph comparison function for this 
optimum adaptation are determined for the comparison image by means of the above- 
described method. 

On the basis of a comparison between the respective graph comparison functions corre- 
sponding to the optimum adaptations of the reference images to the comparison image, the 
reference image which is most similar to the comparison image can be ascertained. 
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In addition, by evaluating the graph comparison functions for all reference images it will be 
possible to determine a measure of the significance of the respective similarity. According 
to the necessary degree of similarity, different definitions for a significant recognition can be 
used in this connection. 



For example, the average S and the variance a s can be formed from all the graph 
comparison functions for the non-optimum reference graphs. A significant similarity 
could be assumed if 



s opt -s 2 ^ 



(17) 



(18) 



is fulfilled, wherein s is fixed parameter chosen and wherein S 2 is the second smallest 
value of all graph comparison functions. 

Fig. 4 shows a further embodiment of the present invention. 

This embodiment differs from the hitherto described embodiments with respect to the 
structure of the reference graphs which are compared with the comparison graphs. 

Whereas in the case of the hitherto described embodiments a reference graph has been 
created on the basis of a single reference image, a reference bunch graph results from a 
plurality of reference images in the case of this embodiment. 

For this purpose, M model graphs are created on the basis of M images, said model graphs 
being combined in a so-called reference bunch graph. 

All M model graphs have the same qualitative structure, i.e. they have N nodes which are 
linked by a predetermined grid. In this connection, it is, however, admissible that the lengths 
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of two corresponding links are different. Hence, it is only demanded that the model graphs 
are topologically identical. The structure of the grid may have a regular form, as shown in 
the present connection, or an irregular form. 

Hence, it is in particular possible to use the grids that have been used in the above- 
discussed embodiments, i.e. a regular nxm grid or an irregular object-adapted grid. 

In addition to the lengths of two corresponding links that differ, also the corresponding jets 
of the M model graphs are different. 

The M model graphs are finally combined so as to form a bunch graph, as will be explained 
hereinbelow. 

To begin with, the mean distance vectors A s between the nodes i and j in each bunch 
graph are ascertained by: 



wherein A™ is the distance vector between the nodes i and j in the model graph m. 



These distance vectors now determine the structure of the bunch graph which is af- 
terwards projected into the comparison image for the purpose of comparison. 

The nodes of the bunch graphs have additionally assigned thereto bunch jets of the 
M model graphs. These bunch jets comprise all sub-jets which have been ascer- 
tained during the creation of the respective reference graphs. Hence, a jet of the 
bunch graph comprises the M corresponding jets of the M model graphs. In other 
words, a jet of the reference bunch graph is composed of the respective sub-jets cor- 
responding to the sub-jets of the model graphs. 
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The resultant structure is schematically shown in Fig. 4. Gi,..., Gm designate here the 
M model graphs which are combined so as to form the bunch graph B M 40. 

For carrying out the comparison the bunch jets are associated with sub-bunch jets. 
Criteria which can be used as association criteria are e.g. the feature classes, the ref- 
erence images or mixed forms of these two. In the case of an association according to 
classes of features, the sub-bunch jets only comprise the features of a single class of 
features. 

For comparing a bunch graph B M 40 obtained in this way with a comparison graph G' 45 
resulting from an image 42, a bunch graph comparison function which is analogous to 
equation (6) is used according to this embodiment. 

The jet comparison function S Jet is in this case determined in the way explained herein- 
below. 

To begin with a comparison function between a sub-jet j' of the image and the corre- 
sponding sub-bunch jets b M is determined. For this purpose, the following equations, 
which are analogous to equations (10) to (13), can be used by way of example: 



S(b M ,j') = 5> n S n (jI?,j'),or 
S(b M ,j , ) = n( S n(Cj')r n .°r 
S^j'^max^AUnJ')}.' 



or 



(22) 



(20) 



(21) 




(23) 



j' is here a sub-jet of the image and jjf is the corresponding sub-bunch jet; the 
s n(in . J') are determined e.g. according to equation (7) or (8). 
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A functional relation Q exists between the comparisons of the sub-jets and the sub- 
bunch jets on the one hand and the comparison function for the jet J with the bunch 
graph B M on the other: 



S(B M , J' ) = n({S kl (b?, \; )}) =: Q(M) . (24) 
The function D. can in this case be determined according to the following recursion: 

n<°) (M) = J] © (M[ 1) ) , or (25) 

n<°> (M) = Yl (M, (1> J)" 1 , or (26) 

n (0) (M) = max{©,nf 1) (M| 1) )} , or (27) 

O (0) (M) = mjn{© (M[ 1) )} , wherein (J M, (1) = M , and (28) 



a (m-1) (M (m-1) j = £ Q _ Q (m) (M <m> j _ Qr (2g) 

i 

^D (M (D j = Y[ (a< m) (Mj m) ))"' , or (30) 

n ("-i> (M (m-i)) = m pc{cD j^M™)} , or (31) 

^(m-D^m-i)) = m_in{ Q .nj m) (Mj m) )} , wherein (J Mj m > = Mf"^ . (32) 



Depending on the respective case of use, the recursion can be carried out until the 
following condition is fulfilled for M (m) : 

|M (m) | = 1. 
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Making use of the comparison functions for the jet J with the bunch graph B M for the indi- 
vidual jets, the jet comparison function S Je t for ail the corresponding jets of a reference 
bunch graph B M and of a comparison graph G' is finally formed. For this purpose, various 
functions can be used, again in dependence upon the respective case of use. The com- 
parison function for n nodes can, for example, be formed according to: 

S Jet (B M , G ) = J a> A (B J, J; ) , or (33) 
S Je ,(B M ,G') = n(S n (Br,J n , )r. (34) 

This comparison function can finally be inserted in equation (6) for determining the 
graph comparison function. 

Expressed in words, the jets having the maximum similarity are selected from the 
bunch graph B M , when said bunch graph B M is compared with a comparison graph G. 

In Fig. 4 this fact is expressed by arrows which extend from the respective node of 
the comparison graph G and which end at different model graphs. 

In addition to the above-mentioned bunch graph comparison function also other suit- 
able comparison functions can be used. 

When a bunch graph is used, this bunch graph will, just as in the case of a compari- 
son with a single reference graph, first be projected into the image of the comparison 
graph and, subsequently, the optimum projection will be determined by evaluating the 
bunch graph comparison function. 

Since a bunch graph can be treated like a single graph, it is also possible to combine a 
plurality of reference bunch graphs, one reference bunch graph and one or a plurality of 
reference graphs in a data base with which the comparison graphs are to be compared. 

Making reference to Fig. 4 and Fig. 5, a concrete example of hand position recognition in 
front of a complex background according to the above-described method will be de- 
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scribed in the following, said method making use of features which result from a convolu- 
tion of the image data with Gabor filters (Gabor features), from a convolution of colour- 
segmented image data with Gabor filters (colour-gabor features) and from the HSI infor- 
mation (HSI features). This example is compared with a recognition method in the case 
of which only a single class is taken into account, i.e. the respective weighting coeffi- 
cients cok are equal to zero. 

In Fig. 5 the representative reference images are shown, which have been used for cre- 
ating reference graphs according to the above-described method. Each reference graph 
comprises 15 nodes and 20 links or connections. The nodes were manually distributed at 
anatomically significant points. 

In Fig. 6 various examples of a hand position in front of different backgrounds are shown. 
In total, 29 backgrounds have been used, among which five contained a high degree of 
skin colour, eleven a medium degree of skin colour and eight a small degree of skin col- 
our. 

Making use of these backgrounds, 1000 different comparison graphs have been created. 

From the reference data, 18 reference graphs which contained Gabor features or colour- 
gabor features or HSI information were determined for each of the hand positions shown 
in Fig. 5. Gabor filters with three different magnitudes and eight different directions were 
used for the convolution. 

From the respective 18 reference graphs three bunch graphs, each comprising 6 
models, were formed. The features of the sub-jets were used as a criterion for the as- 
sociation of the sub-jets with the reference graphs. Accordingly, the first reference 
bunch graph contained all Gabor features, the second reference bunch graph con- 
tained all colour-gabor features and the third reference bunch graph contained all HSI 
features. 

Upon projecting the reference bunch graphs, a rotation of up to 15°, a scaling of up to 
20% and a local distortion by at most one pixel were admitted. 
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The graph comparison function was calculated by means of the equations (6; X = 0 ), 
(33; with identical ©J, (24), (25; with a Gabor = 0,25 , ©colour Gabor = 0.25, © HSI = 0.5 ), (33; 
with identical © n ), (8) for the Gabor and colour-gabor features and a weighted Eucli- 
dian distance for the HSI colour information. 

The results of the comparison of the 1000 comparison images are summarized in the 
following table: 

weighting simple background complex background 

only Gabor features 82,6% 70,4% 

only colour-gabor fea- 39,7% 34,6% 



tures 



only HSI features 
optimum weighting 



88,2% 
92,9% 



76,3% 
85,8% 



